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R™ent 1 8th century theory, is newJorceio^mpMog- By Michael Kanellos. ZDNet 
News (February 1 9 2003)7 also available from CNET (Old-school theory is a new 
about the J x "Thomas Bayes, one of the leading mathematical lights in computing 
, ™g d) today, differs from most of his colleagues: He has argued that the existence of 
(annotated) ^ n be derjved from equations . H is most important paper was published 
by someone else. And he's been dead for 241 years. Yet the 18th-century 
clergyman's theories on probability have become a major part of the 
mathematical foundations of application development. Search giant Google 
and Autonomy , a company that sells information retrieval tools, both employ 
Bayesian principles to provide likely (but technically never exact) results to 
data searches ... 'Bayesian research is used to make the best gambles on 
where I should flow with computation and bandwidth,' said Eric Horvitz senior 
researcher and group manager of the Adaptive Systems & Interaction Group at 
Microsoft Research. 'I personally believe that probability is at the foundation of 
any intelligence in an uncertain world where you can't know everything^ ... 
Bayesian theory can roughly be boiled down to one principle: To see the 
future one must look at the past. Bayes theorized that the probability of future 
events could be calculated by determining their earlier frequency. ... A related 
technique, called Hidden Markov models, allows probability to anticipate 
sequences. A speech recognition application, for example, knows that the 
sound most likely to follow 'q' is 'u.'" 

Reasoning Under Uncertainty. From Artificial Intelligence, by David B^ Leake, 
Indiana University [to appear, Van Nostrand Scientific Encyclopedia, Ninth 
Edition Wiley, New York, 2002]. "[I]n order to draw useful conclusions, Al 
systems must be able to reason about the probability of events, given their 
current knowledge.... Research on Bayesian reasoning provides methods for 
calculating these probabilities. Bayesian networks, graphical models of the 
relationships between variables of interest, have been applied to a wide range 
of tasks, including natural language understanding, user modeling, and 
medical diagnosis." 

A Brief Introduction to Graphical Models and Bayes ian Networks. By Kevin 
Murphy, a postdoc at the MIT Al lab. A great place to start regardless of your 
level of familiarity! 

Stuart RusseHorjjhe Future of^Mi^LnJMgence- Ubiquity; Volume 4, Issue 
WD^cember 24 - January 6, 2004). "UBIQUITY: Will they be based on a 
probability theory? RUSSELL: Yes. Speech has already gone this route. 
Speech recognition is a giant calculation of posterior probabilities from 
evidence .. At the same time, logical Al tradition has broadened to include 
probability theory. A lot of high-level representation, reasoning and planning 
can go on in a probabilistic formalism." 

"e ^Toffers a 'New' Wa v to Make Se nse^i^mbjers. A 236-year-old ^ 
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approach to statistics is making a oomeback, as its abili ^° ™ 
aswell as hard data finds applications from Pharmaceut.c ab toJM .By 
David Malakoff (1999). Science Magazine, Volume 286, Number 044«, i^ou 
U64. • Advances in computers and the limitations of ^nal 
methods are part of the reason for the new popularity of this old approach. But 
Searchers s P ay the Bayesian approach is also appealing because it allows 
them to factor expertise and prior knowledge into their computations- 
something that traditional methods frown upon." 
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Who was Thomas Bayes? Who was Andrei Andreyevich Markov? 

See our Namesakes page! 
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Causality Moo^Reasoj^^ By Judea Pearl (Cambridge 

S^siWr^^ questions of causality 

^iT^^pinS evidence is required for legitimate inference of cause- 
effect relationships? (2) Given that we are willing to accept causa ^formation 
about a phenomenon, what inferences can we draw from such information and 
how" This book provides a systematic account of this causa transformation, 
addressed primarily to readers in the fields of statistics, artificial intelligence 
phHosophy cognitive science, and the health and social sciences." - from the 
PreS "Links are provided to into„djJCtp V sections oi a^ and to 

selected sections of general interest. 

Hidden Markov Models Tutorial from the School of Computing, University of 
Le^ "Often we are interested in finding patterns which appear over a space 
of time These patterns occur in many areas; the pattern of commands 
forne^se* i instructing a computer, sequences of words in sentences, the 
sequence of phonemes in spoken words - any area where a sequence of 
events occurs could produce useful patterns. ... This is typical of the type of 
system we will consider in this tutorial. * First we will introduce systems which 
Generate probabalistic patterns in time, such as the weather fluctuating 
Seen s'unny and rainy. * We then look at systems where what 
predict is not what we observe - the underlying system is hidden. In the above 
example the observed sequence would be the seaweed and the hidden 
system would be the actual weather. * We then look at some problems that can 
be solved once the system has been modeled." 

Bavesian Networks without Tears. Eugene Charniak (1991). Al Magazine 12 
f^f|^^^ Bayesian networks for Al researches v«tti 

a limited grounding in probability theory. Over the last few years, this method of 
rea^ probabilities has become popular within the Al probab.l.ty and 
uncertainty community." 

Formula for 'Clippy' originaJed^tuneAagp, Reuters. Available from 

CNN co^ rW^2"20oT) "Roughly speaking, Bayes 1 theorem adds common 
STse tc ?thei £aths used to work out how likely something is. It introduces yes- 
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no computers to grey areas, doubt and best guesses." 

Associati^^ homepage. 

"B Course is a web-based interactive tutorial on Bayesian modeling, in 
oartSaTdependence modeling. However, it is more than just a tutorial. It is 
S atee dafa analysis tool that makes it possible for you to use your own 
data as example data for the tutorial." 

Ravesian Belief Nets. A collection of resources from Russell Greiner that 
fSS^lfs 1 ^ the popular press, tutorials, applications, research 
groups and much more. 

ai on the Web- Reasoning with Uncertainty, A resource companion to Stuart 
Russena^^ Intelligence: A Modern Approach" with 

K^ren^^rlal. people, research groups, books, companies and 
much more. 

Probabilistic Thinking. By Professor Richard Jeffrey Professor Emeritus, 
PrS Professor of Social Science UCI. 

"P obabHistr hinking was a mid-17th century artifact originating in a famous 
c^wndenS belSeen Fermat and Pascal - a correspondence on which 
Huvaens based a widely read textbook: On Calculating in Games of Luck 
M657) The probabilistic framework didn't exist until those people : cobbled it 
together It remains in use today, much as in Huygens's book, -from the 
Preface 

g-^Qf^^^^ CAMISV Medicine is 

deplete wUh uncertainty. In particular, there is uncertainty due to incomplete 
and inexact scientific models of human health and disease, and there is 
unceS5 ^ndary to incomplete and erroneous data about 'nd.v.dual 
Sa^!we15e exploring the use of probability theory as a representation of 
uncertainty in medical diagnostic systems. 

r^-^r ri ■ An FvidPntial ReasoninoSystern. "SRI's work in automated 

. don't miss possibilistic reasoning: "Possibilistic methods exploil t the 
relations of similarity and of relative preference between alternate 
explanations of the evidence." 

•The Societvfcj^fi^^ 18 a non P r ° f,t ° r 9 anization ' 

interactions 

between researchers in AI and Statistics. 
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Marek J. Druzdzel's Molsofmm related to the "decision analytic approach to 
decision making under uncertainty." 

Fair Use Notice ©2000^004^AAAi 
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